N89- 22345 
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ABSTRACT 

Vector Quantization (VQ) is fast becoming an accepted, if not 
preferred method for image compression. VQ performs well when 
compressing all types of imagery including Video, Electro-Optical 
(EO) , Infrared (IR) , Synthetic Aperture Radar (SAR) , Multi-Spectral 
(MS) , and digital map data. The only requirement is to change the 
codebook to switch the compressor from one image sensor to another. 
However, codebooks can be difficult to design because data may not be 
available or may not accurately represent the pdf. This stimulates 
the need for an algorithm that can simultaneously design a codebook 
while vector quantizing the data. 

There are several approaches for designing codebooks for a vector 
quantizer. The most common algorithm being the LBG or generalized 
Lloyd. Entries in the codebook represent the centroid of the data 
that is associated with a respective Voroni region. A quantizer is 
uniquely defined by the codebook centroids and the distortion metric. 
The LBG algorithm is used to minimize the overall distortion of the 
quantizer by iteratively moving the centroids and computing the new 
distortion until the quantizer converges on a local minimum. Previous 
implementations of the LBG algorithm compute the centroid by adding 
all the vectors in the Voroni region and then dividing by the number 
of vectors. This is done iteratively on a sample of source data 
referred to as a training sequence. 

Adaptive Vector Quantization is a procedure that simultaneously 
designs codebooks as the data is being encoded or quantized. This is 
done by computing the centroid as a recursive moving average where the 
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centroids move after every vector is encoded. When computing the 
centroid of a fixed set of vectors the resultant centroid is identical 
to the previous centroid calculation. This method of centroid 
calculation can be easily combined with VQ encoding techniques. The 
defined quantizer changes after every encoded vector by recursively 
updating the centroid of minimum distance which is the selected by the 
encoder. Since the quantizer is changing definition or states after 
every encoded vector, the decoder must now receive updates to the 
codebook. This is done as side information by multiplexing bits into 
the compressed source data. It is important to note that the 

quantizer converges in much the same way as the LBG algorithm 
converges. For stationary data sources the centroids will become 
fixed and the side information will not be necessary. For non- 
stationary sources the side information can be used to allow the 
quantizer to adapt to the data, thereby providing an Adaptive Vector 
Quantizer. Important issues to consider are the rate of convergence, 
start-up distortion or rate overhead, and tracking non-stat ionary 
sources. These issues will be addressed in a forthcoming publication. 
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Vector Quantization Decoding 


Present Implementation of VQ 

• Acquire data from sensor 

• Design a codebook 

• Implement a search technique 


Acquire Data from the sensor 

• Expensive 

• Classified 

• Not possible 

• Poor representative 
(start over) 
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Codebook Design 

• Exhaustive Search 

• Generalized Lloyd (LBG) 

• K-means 


• Simulated Annealing 

• Pairwise Nearest Neighbor (PNN) 
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Generalized Lloyd using a training sequence 

• Acquire training sequence 
(lots of samples of source data) 

• Create vectors by grouping samples 
(maximize correlation) 
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• Design codebook 

1. Initialize codebook 

Place a set of quantization points in the vector space 

2. Encode training sequence 

Assign each vector from the training sequence to the closest 
quantization point 

3. Reassign codebook 

Compute the centroid of each set of training sequence vectors assigned 
to a codebook vector and reassign the codebook to be these new 
centroids 

4. Iterate 2 and 3 

Iterate until no change (or minor change) to the overall distortion 


Encoding the Source Vectors 
Using Full Search 

• Compute the quantization error (distortion) 
between the source vector and each vector 
in the codebook 


• Replace the source vector with the index 
to the vector of minimum distortion 



Tree 
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NON-UNIFORM BINARY TREE SEARCH 



Each level computes s • v(j) > T(j) where 
• v(j) = C 2 (j) - Cr(j) 
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Adaptive Vector Quantization 

• Combines principles of codebook design with, 
encoding 

• Requires no source samples of data to start 
(training sequence) 

• Removes logistics problem of changing code- 
books 
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Recursive Codebook Design 

• Initialize codebook vectors 

• Encode a source vector as before by looking 
at each entry in the codebook and choosing 
entry of minimum distortion 

• Update the codebook vector sifter every en- 
coded source vector 

• Send Achange as side information 
Changing Codebook Values 

• Codebook entries are the centroids of the 
Voroni region 

• Centroid computation 
1 C - jfXiLi Xi 

2. C n = t^Cn - 1 + \x n n = 0, 1 , N 

• Codebook is a set of changing centroids 

2/r»l nj Vni—1 "b ^ x n\ ^1 ••• 

Vn 2 = ^yn 2 - 1 + *2 = 0, 1, ... 

m 

VriM = n M y»M~l d* nJ^ Xn M n M ~ *" 

• Centroids converge in much the same way 
as the Generalized Lloyd algorithm 
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Things to Consider 

• Start-up 

— Increase rate 
— Increase distortion 
— Reset 

• Convergence 

• Register overflow 

— N counts 
— a divides 

• Overhead for side information 

• Performance 

• Stationarity of source 
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